Image processing apparatus, image processing method, and storage medium

ABSTRACT

An image processing apparatus which is capable of preventing wasteful transmission of metadata. Metadata is registered in advance in association with a type of a transmission destination of an image data. When transmitting the image data, metadata associated with the type of the transmission destination of the image data is determined, and the image data and the determined metadata are transmitted to the transmission destination.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing apparatus, an imageprocessing method, and a program, and more particularly to an imageprocessing apparatus which is capable of processing metadata, an imageprocessing method therefor, and a storage medium for storing a programfor implementing the image processing method.

2. Description of the Related Art

Recently, there has been proposed a digital multifunction peripheral(MFP) provided with a function of reading a rasterized image by ascanner, classifying the read rasterized image into objects, such astext objects and graphic objects, filing the objects, and reusing thefiled objects (see e.g. Japanese Patent Laid-Open Publication No.H05-342408).

Further, a technique has been proposed in which metadata (attachedinformation on data) is attached to image data so as to make it possibleto carry out processing accurately reflecting the properties of imagedata (see e.g. Japanese Patent Laid-Open Publication No. 2006-025129).This technique enables an application to optimally process desired imagedata using metadata attached to the image data.

However, in the technique disclosed in Japanese Patent Laid-OpenPublications No. 2006-025129, whenever image data is transmitted for useby an application, metadata as well is sent to the application in astate attached to the image data. Necessary metadata differs fromapplication to application, and hence metadata useful for oneapplication may not be necessitated by another. Therefore, if data isalways transmitted within a system, with all metadata attached thereto,it is considered that useless information is sometimes wastefullytransmitted, which causes an increase in the amount of transmitted dataand resultant delay in transmission processing.

SUMMARY OF THE INVENTION

The present invention provides an image processing apparatus which iscapable of preventing wasteful transmission of metadata, an imageprocessing method therefor, and a storage medium for storing a programfor implementing the image processing method.

In a first aspect of the present invention, there is provided an imageprocessing apparatus comprising an acquisition unit adapted to acquireimage data, a generation unit adapted to generate metadata for the imagedata, a registration unit adapted to register an output destination towhich the generated metadata is to be output, and an output unit adaptedto output the image data to the output destination, wherein the outputunit outputs the metadata only when the image data is output to theregistered output destination.

In a second aspect of the present invention, there is provided an imageprocessing method for controlling an image processing apparatus,comprising acquiring image data, generating metadata for the image data,registering an output destination to which the generated metadata is tobe output, and outputting the image data to the output destination,wherein the outputting includes outputting the metadata only when theimage data is output to the registered output destination.

In a third aspect of the present invention, there is provided a storagemedium storing a program for causing a computer to execute an imageprocessing method for controlling an image processing apparatus, whereinthe image processing method comprises acquiring image data, generatingmetadata for the image data, registering an output destination to whichthe generated metadata is to be output, and outputting the image data tothe output destination, wherein the outputting includes outputting themetadata only when the image data is output to the registered outputdestination.

In a fourth aspect of the present invention, there is provided an imageprocessing apparatus comprising a registration unit adapted to generatea plurality of metadata items for image data, and register the pluralityof generated metadata items each in association with information on atransmission destination type, a determination unit adapted todetermine, when transmitting the image data stored in a storage to atransmission destination, a metadata item which is associated with thetype of the transmission destination, from the plurality of generatedmetadata items, and a transmission unit adapted to transmit the imagedata and the determined metadata to the transmission destination.

In a fifth aspect of the present invention, there is provided an imageprocessing method comprising a registration step of generating aplurality of metadata items for image data, and registering theplurality of generated metadata items each in association withinformation on a transmission destination type, a determination step ofdetermining, when transmitting the image data stored in a storage to atransmission destination, a metadata item which is associated with thetype of the transmission destination, from the plurality of generatedmetadata items, and a transmission step of transmitting the image dataand the determined metadata to the transmission destination.

In a sixth aspect of the present invention, there is provided acomputer-readable storage medium storing a computer program, wherein thecomputer program causes a computer to execute a registration step ofgenerating a plurality of metadata items for image data, and registeringthe plurality of generated metadata items each in association withinformation on a transmission destination type, a determination step ofdetermining, when transmitting the image data stored in a storage to atransmission destination, a metadata item which is associated with thetype of the transmission destination, from the plurality of generatedmetadata items, and a transmission step of transmitting the image dataand the determined metadata to the transmission destination.

According to the present invention, output destinations (e.g.application-specific ones) for respective generated metadata items areregistered in advance, and metadata transmission to an application isperformed such that only a metadata item suitable for the application isoutput. Therefore, it is possible to prevent wasteful transmission ofmetadata.

The features and advantages of the invention will become more apparentfrom the following detailed description taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of an image processing system including an imageprocessing apparatus according to an embodiment of the presentinvention.

FIG. 2 is a block diagram of the internal configuration of an MFPappearing in FIG. 1.

FIG. 3 is a flowchart of a meta image data-generating process executedby the MFP in FIG. 2.

FIG. 4 is a flowchart of a process for conversion into vector data,which is executed in a step S301 in FIG. 3.

FIG. 5 is a flowchart of an image data analysis process executed in astep S302 in FIG. 3.

FIG. 6 is a diagram useful in explaining a wraparoundinformation-generating process executed in a step S503 in FIG. 5.

FIG. 7 is a diagram of an example of the structure of a meta image datafile generated by the meta image data-generating process in FIG. 3.

FIG. 8 is a diagram of an example of the structure of an object 0appearing in FIG. 7.

FIG. 9 is a flowchart of a file transmission process executed by the MFPin FIG. 2.

FIG. 10 is a flowchart of a variation of the image data analysis processin FIG. 5.

FIG. 11 is a diagram of an example the structure of an object nappearing in FIG. 7.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The present invention will now be described in detail below withreference to the accompanying drawings showing embodiments thereof.

FIG. 1 is a diagram of an image processing system including an imageprocessing apparatus according to the embodiment of the presentinvention.

As shown in FIG. 1, the image processing system is comprised of adigital multifunction peripheral (hereinafter referred to as “the MFP”)100 as an image processing apparatus, external apparatuses 103 and 104.The MFP 100 is connected to the external apparatuses 103 and 104 via anetwork 102. It should be noted that the number of external apparatusesincluded in the image processing system is not limited to two, but anynumber of apparatuses may be connected to the network 102 as externalapparatuses.

FIG. 2 is a block diagram showing the internal configuration of the MFP100 appearing in FIG. 1.

As shown in FIG. 2, the MFP 100 is comprised of an image reader 110, astorage section 111, a printer section 112, an input section 113, anetwork interface 114, a data processing section 115, and a displaysection 116.

The image reader 110 is provided with an auto document feeder (ADF). Theimage reader 110 irradiates an image on each sheet of a bundle of sheetoriginals or on a single sheet original fed by the auto document feeder,with light from a light source, not shown, and causes reflected lightfrom the sheet original to form an image on a solid-state image pickupdevice, using lenses, not shown. Further, the image reader 110 acquiresa rasterized image reading signal as image information (raster imagedata) with a predetermined resolution (of e.g. 600 DPI) from thesolid-state image pickup device having the image formed thereon.

The MFP 100 has a copy function for printing an image corresponding tothe image reading signal on a recording medium in the printer section112. In the case of copying one original image, the data processingsection 115 carries out image processing on the image reading signal tothereby generate a recording signal, and then the printer section 112performs printing using the recording signal generated by the dataprocessing section 115, on the recording medium. On the other hand, inthe case of copying a plurality of original images, recording signalssequentially generated from the respective original images by the dataprocessing section 115 are sequentially stored in the storage medium111, and then the recording signals stored in the storage medium 111 aresequentially output to the printer section 112. The printer section 112performs printing on recording media sequentially using the recordingsignals.

The data processing section 115 analyzes the characteristics of eachimage reading signal acquired by the image reader 110 (e.g. through acharacter recognition process and an image analysis process) and thengenerates metadata based on the results of the analysis. Further, thedata processing section 115 converts the image reading signal acquiredby the image reader 110 into an image file in a compressed image fileformat, such as the TIFF format or the JPEG format, or in a vector datafile format, such as the PDF format, to thereby acquire image data.Then, the data processing section 115 attaches the metadata to the imagedata to generate meta image data. It should be noted that in the presentembodiment, image data having metadata attached thereto is referred toas meta image data.

In the case of sending the meta image data as a file to the externalapparatus 103 or 104, the data processing section 115 outputs thegenerated meta image data to the external apparatus 103 or 104 via thenetwork interface 114 and the network 102.

Further, the data processing section 115 receives print data output fromthe external apparatus 103 or 104, via the network interface 114. Thedata processing section 115 converts the received print data into rasterdata printable by the printer section 112, followed by causing theprinter section 112 to print the raster data on a recording medium.

An operator inputs an instruction to the MFP 100 using the input section113 comprised of a key operating section and a touch panel, and thedisplay section 116. The input by the operator is controlled by acontroller (not shown) provided in the data processing section 115. Thestatus of the input by the operator and image data being currentlyprocessed are displayed on the display section 116.

The storage section 111 is implemented e.g. by a large-capacity harddisk. The storage section 111 forms a database that stores and managesimage data read by the image reader unit 110, meta image data generatedby the data processing section 115, and image data sent from theexternal apparatuses 103 and 104.

FIG. 3 is a flowchart of a meta image data-generating process executedby the MFP 100 in FIG. 2.

In the meta image data-generating process, image data is read from anoriginal by the image reader unit 110, and a vector data forming processand an image data analysis process are carried out on the read imagedata, to thereby generate meta image data.

Referring to FIG. 3, the image reader unit 110 reads image data from anoriginal according to an instruction input by the operator via the inputsection 113 (step S300). Specifically, the image reader unit 110raster-scans each sheet original and acquires e.g. a 600 DPI 8-bit imagereading signal. The data processing section 115 carries outpre-processing on the image reading signal and then stores the processedimage reading signal as image data for one page in the storage section111.

Next, a CPU (not shown) provided in the data processing section 115executes the process for conversion into vector data, describedhereinafter with reference to FIG. 4, on the image data stored in thestorage section 111 (step S301). In the process for conversion intovector data, the data processing section 115 divides the image data intoobjects, and converts each divided object into vector data to therebygenerate a vector data file.

Then, the data processing section 115 executes the image data analysisprocess, described hereinafter with reference to FIG. 5, on the imagedata subjected to the process for conversion into vector data i.e. thevector data file (step S302). In the image data analysis process, thedata processing section 115 analyzes the image data (vector data) andthen generates metadata based on the results of the analysis. Further,the data processing section 115 stores the generated metadata inassociation with the vector data to generate meta image data.

Next, post-processing is carried out on the generated meta image data(step S303), followed by terminating the present process. For example,in the case of post-processing for copying, the data processing section115 performs image processing including color processing and spatialfrequency correction, which is best suited for each object, and theprinter unit 112 prints the processed data. In the case ofpost-processing for file storage, the data processing section 115 storesthe generated vector data in the storage section 111. Further, in thecase of post-processing for file transmission, the data processingsection 115 generates a file having a meta image data format formed byby attaching the metadata to the vector data file, and sends the file toa file transmission destination (e.g. the external apparatus 103) viathe network interface 114. In this case, only metadata of a type ortypes suited to the file transmission destination (i.e. metadata of atype or types necessitated by the file transmission destination) istransmitted.

FIG. 4 is a flowchart of the process for conversion into vector dataexecuted in the step S301 in FIG. 3.

Referring to FIG. 4, the data processing section 115 carries out blockselection processing (dividing-into-regions processing) (step S400) todivide the image data into objects which are in the form of so-calledblock-shaped regions independent of each other. Specifically, the imagedata stored in the storage section 111 for processing is divided intothe regions of a character/line portion and a halftone image portion.Further, the character/line portion is divided into blocks formed byrespective chunks of paragraphs, and tables and graphics formed bylines. On the other hand, the halftone image portion is divided intoimage portions, background portions, etc., as respective separaterectangular blocks. By execution of this dividing-into-regionsprocessing, the image data is divided into regions according toattributes thereof.

In the present embodiment, it is assumed that objects are classifiedinto the categories of text (character) objects, graphic (thinline/graphic) objects, table objects, image objects (natural images),and background objects. It should be noted that the categories ofobjects are not limited to these, but any other category may be usedaccording to a use or a purpose. Further, it is not necessary to use allthe above-mentioned categories of objects.

Next, the data processing section 115 carries out OCR processing on textobjects obtained by the block selection processing in the step S400(step S401).

Then, the data processing section 115 carries out process for convertingeach object obtained by the block selection processing in the step S400into vector data (step S402). For example, as for a text objectsubjected to the OCR processing, the data processing section 115recognizes and identifies the character code, character size, and fontof each character to thereby convert the text object into font datavisually faithful to the character obtained by scanning the original. Agraphic object is converted into an outlined/function-approximatedfunction. An image object is subjected to low compression (e.g. low JPEGcompression) with its reading resolution of the image reader unit 110held at 600 DPI so as to be converted into an individual JPEG file asimage data. As for a table object, numeral information items in thetable object are converted into font data, and a table portion isconverted into an outlined/function-approximated function. The numeralinformation items are associated with each other as cell information,and the cell information is encoded as a table object. Although in thepresent embodiment, the text object is expressed as vector data, usingcharacter codes, character sizes, fonts, etc., recognized by characterrecognition, this is not limitative. For example, vector data may begenerated by carrying out outlining processing and functionapproximation on the contour of the text object, as in the case ofprocessing a graphic object, and the vector data thus obtained may beused e.g. for printing.

Next, the data processing section 115 carries out background processingon the background objects (step S403). In the background processing,histograms of the respective RGB colors are generated for an imageassociated with each background object, and when it is determined basedon the histograms that a background object is data uniform in colordistribution, the background object is converted into vector dataindicating a rectangular region and color information (e.g. averagecolor) indicating the color, and is stored. On the other hand, when itis determined that a background object is data non-uniform in colordistribution, the resolution of the background object is converted from600 DPI to a low resolution (e.g. 300 DPI), and then the backgroundobject is subjected to high compression (e.g. high JPEG compression),and is stored.

It should be noted that compression performed at a higher compressionrate than a predetermined compression rate (e.g. 50%), for example, isdefined as high compression, while compression performed at a lowercompression rate than the predetermined compression rate, for example,is defined as low compression.

Next, layout information and attribute information associated with eachobject are stored in the storage section 111 as a vector data file (stepS404), followed by terminating the present process.

The vector data file obtained by the above-described process containsall vector information in a state visually very close to the readoriginal image, in an editable form, and the vector information can bedirectly processed, reused, accumulated, transmitted, or reprinted.

FIG. 5 is a flowchart of the image data analysis process executed in thestep S302 in FIG. 3.

As shown in FIG. 5, first, vector data associated with each object isread out from the vector data file stored in the storage section 111(step S500).

Next, it is determined whether or not the read-out vector data is vectordata of a text object (step S501). If the read-out vector data is vectordata of a text object, the process proceeds to a step S502. In thepresent embodiment, by carrying out processing, described hereinbelow,character strings are not only stored but also wraparound information onthe character strings, which is necessitated by the application, isgenerated and stored as metadata. It should be noted that if it isdetermined in the step S501 that the read-out vector data does notcontain vector data of a text object, the present process is immediatelyterminated.

In the step S502, the number of characters in the text object iscounted, and it is determined whether the number of characters is notsmaller than a predetermined value N set by the CPU provided in the dataprocessing section 115. If it is determined that the number ofcharacters is not smaller than the predetermined value N, the processproceeds to a step S503. On the other hand, if the number of charactersis smaller than the predetermined value N, the present process isimmediately terminated.

In the step S503, a wraparound information-generating process isexecuted, followed by terminating the present process. Specifically,wraparound information is generated as metadata for the text object, andthe generated wraparound information is stored in association with thetext object.

Wraparound information is for controlling text layout in a case where atext object is reused e.g. by the external apparatus 103. Wraparoundinformation is boundary information indicative of a boundary where a newline is started or where a text object is divided into two text boxes.This boundary information may simply be the number of charactersenabling uniform distribution of all characters, or alternatively, maybe configured to be the number of characters which indicates theposition of a boundary between specific characters recognized by OCRprocessing (e.g. a boundary between a kanji character string and anumeral string, a boundary between a full-size character string and ahalf-size character string, or a boundary between different charactertypes).

FIG. 6 is a diagram useful in explaining the wraparoundinformation-generating process executed in the step S503 in FIG. 5.

In FIG. 6, in the MFP 100, the numbers 7 and 14 of characters eachindicative of a boundary between a numeral string and a kanji characterstring included in a character string representing an address inJapanese are set as wraparound information, and meta image data isgenerated by attaching the wraparound information as metadata to thetext object. Further, the MFP 100 transmits this meta image data as afile to the external apparatus 104.

In some type of application of the external apparatus 104 havingreceived meta image data transmitted from the MFP 100, it is sometimesdesired to display a character string in a state having wrapped around.In such an application, the text object is displayed with its characterstring automatically wrapping around based on the number of charactersattached as wraparound information indicating a boundary for breakingthe character string. This makes it possible to display the text objectin a manner easy to be viewed by the operator.

FIG. 7 is a diagram of the structure of a file of meta image datagenerated by the meta image data-generating process in FIG. 3.

As shown in FIG. 7, the meta image data 700 is comprised of a headersection 701, a layout data section 702, and an image data section 710.

The header section 701 stores information for identifying the componentsof the meta image data 700.

The layout data section 702 stores attribute information associated witheach of objects, such as text objects, image objects, and table objects,in the original image, and layout information as rectangular addressinformation indicative of positions where the respective objects aredisposed.

The image data section 710 is comprised of a text data section 703, atable data section 704, a graphic data section 705, and an image datasection 706. The image data section 710 stores image data subjected tothe process for conversion into vector data, in which an object 0 (707)and objects 1 (708) to n (709) are sequentially stored in respectiveassociated ones of data sections on an object type-by-object type basis.For example, the object 0 (707) is a text object, and hence it is storedin the text data section 703.

FIG. 8 is a diagram of the structure of the object appearing in FIG. 7.

As shown in FIG. 8, the object (object 0 (707) in the illustratedexample) is comprised of a data field 800 and a meta field 801.

The data field 800 stores information representative of the entity ofthe object 0. The data field of a text object stores results ofcharacter recognition performed for recognition of characters in thetext object.

The meta field 801 stores an object ID, an attribute ID indicative ofthe attribute of the object, application IDs for which associatedmetadata items are valid, and the metadata items to be applied torespective applications (i.e. metadata items necessitated by therespective applications). The metadata items are information associatedwith the object 0 (707), such as wraparound information and editinformation.

It should be noted that data fields of respective objects other than thetext objects store, for example, the following information: The datafield of a table object stores information on details of the structureof the table object. The data field of a graphic object storesinformation of outline data of the graphic object. The data field of animage object stores the image object cut out from image data.

FIG. 9 is a flowchart of a file transmission process executed by the MFP100 in FIG. 2 in the step S303 in FIG. 3.

As shown in FIG. 9, first, the CPU provided in the data processingsection 115 communicates with a transmission destination (e.g. theexternal apparatus 103) via the network interface 114 to confirm anapplication type or application types in the transmission destination(step S900). For example, application types are classified into thefollowing categories, and each application type is assigned an ID foridentification by the MFP 100.

00: document input application

01: graphics drawing application

10: spreadsheet application

11: others

Then, the meta image data except the metadata is sent to thetransmission destination via the network interface 114 (step S901).Specifically, the data processing section 115 reads out the meta imagedata file from the storage section 111 and transmits the data via thenetwork interface 114over the network sequentially starting from theheader section 701 up to the data field 800 of the object 0 (707) of theimage data section 710.

Next, it is determined whether or not the object being processed fortransmission (the object 0 in the present case) has metadata to be sentto any of the applications in the transmission destination (step S902).Specifically, the data processing section 115 determines whether thereis any metadata stored in the meta field 801 of the object beingprocessed for transmission, together with an ID associated with any ofthe application types confirmed in the step S900.

If it is determined in the step S902 that the object being processed fortransmission has any metadata to be sent to any of the applications ofthe transmission destination, the process proceeds to a step S903. Onthe other hand, if the object has no metadata to be sent to any of theapplications of the transmission destination, it means that all themetadata, if any, of the object being processed for transmission hasbeen transmitted, and hence the process proceeds to a step 904.

In the step S903, the data processing section 115 extracts the metadatato be sent to the application of the transmission destination and sendsthe metadata to the transmission destination, and then the processproceeds to the step S904.

In the step S904, it is determined whether or not transmission of allthe objects of the image data section 710 has been completed. If thetransmission has not been completed, the process returns to the stepS900 to start processing for transmitting the next object. On the otherhand, if transmission of all the objects has been completed, the presentprocess is immediately terminated. Determination as to whether or nottransmission of all the objects has been completed may be made by amethod in which the number of objects in the image data section 710 isstored in the header section 701 in advance and it is determined whetheror not the number of transmitted objects has reached the stored numberof objects. Alternatively, a method may be employed in which a specialdata pattern is set and disposed at the end of the meta image data filein advance, and it is determined whether or not the special data patternhas been reached.

According to the process in FIG. 9, the MFP 100 sends, for example,wraparound information to the document input application, which isassigned the application ID 00, of a transmission destination. Theapplication of the transmission destination can provide easy-to-viewdisplay of a text object by starting new lines in the text object basedon the received wraparound information.

Further, since the MFP 100 does not send wraparound information to anapplication, such as a graphics drawing application, which does not needthe wraparound information, it is possible to prevent wastefultransmission of metadata to thereby transmit meta image data morequickly.

FIG. 10 is a flowchart of a variation of the image data analysis processin FIG. 5.

As distinct from the FIG. 5 process in which wraparound information isattached to a text object, as metadata, in the FIG. 10 process, keywordinformation is attached to an image object, as metadata.

Referring to FIG. 10, first, vector data of each object and associatedlayout information are read out from a vector data file stored in thestorage section 111 (step S1000).

Next, it is determined whether or not the read-out vector data is vectordata of an image object (step S1001). If the read-out vector data isvector data of an image object, the process proceeds to a step S1002. Onthe other hand, if the read-out vector data is not vector data an imageobject, the present process is immediately terminated.

In the step S1002, it is determined whether or not a text object existsin the vicinity of the image object. Specifically, a text object closestin position to the image object is identified based on the layoutinformation read out in the step S1000, and it is determined whether ornot the identified text object is within a predetermined distance fromthe image object. As a result of this determination, if a text objectexists in the vicinity of the image object, the process proceeds to astep S1003, whereas if not, the present process is immediatelyterminated.

In the step S1003, a keyword information-generating process is executed,followed by terminating the present process. Specifically, keywordinformation is generated as metadata to be attached to the image objectwith a text object located in the vicinity thereof, and the generatedkeyword information is stored in the storage section 111 in associationwith the image object.

The keyword information is used for defining the title of an imageobject or retrieving an image object, when the image object is reusede.g. by the external apparatus 103. As the keyword information, there isregistered data of a character string in the text object.

FIG. 11 is a diagram of the structure of an object n (709) appearing inFIG. 7.

As shown in FIG. 11, the object n (709) is comprised of a data field1100 and a meta field 1101.

The data field 1100 stores information indicative of the entity of theobject n.

The meta field 1101 stores an object ID, an attribute ID indicative ofthe attribute of the object, application IDs for which associatedmetadata items are valid, and the metadata items to be applied torespective applications. The metadata items are information, such askeyboard information, associated with the object n (709).

According to the process in FIG. 10, the MFP 100 sends keywordinformation for an image object to a graphics drawing applicationassigned an application ID 01 in the transmission destination. Thegraphics drawing application in the transmission destination can use thereceived keyword information for defining the title of the image objector retrieving the image object.

Further, since the MFP 100 does not send keyboard information to anapplication which does not need the keyboard information, it is possibleto prevent wasteful transmission of metadata to thereby transmit metaimage data more quickly.

It should be noted that spreadsheet title row (column) information maybe attached to a table object, as metadata. The spreadsheet title row(column) information is code information indicative of whether or not acell in an uppermost row (or leftmost column) of a table object containsa title. This information is used in image analysis. When textinformation in a cell is different from the kind of information in theother cells, more specifically, e.g. when only a cell in the uppermostrow contains letters and the other rows contain numerals, it isdetermined that the uppermost row is a title row.

Although in the present embodiment, metadata items are registered in ameta field in association with respective applications requiringmetadata transmission, metadata may be registered in association with aspecific person or organization requiring metadata transmission. Forexample, the image processing apparatus may be configured such that whentransmitting meta image data to an organization within one's owncompany, metadata is also transmitted, but when transmitting meta imagedata to an external organization, metadata is inhibited from beingtransmitted.

Further, after checking a security level in a transmission destinationthrough preliminary communication, determination as to whether or not totransmit metadata stored in a meta field may be performed depending onthe security level.

Alternatively, determination as to whether or not to transmit metadatastored in a meta field may be performed depending on a geographic regionwhere a transmission destination lies. In this case, for example, 2-bytecode (Japanese language) of a text object is sent exclusively to outputdestinations in Japan.

Further, a plurality of metadata items may be registered in associationwith each application at the same time.

Furthermore, applications to which metadata is to be transmitted may benarrowed down based on layout information. In this case, for example, amatching pattern associated with the layout information is provided inadvance in the data processing section 115, and comparison is performedbetween the layout information and the matching pattern. Then, only whenit is determined by this comparison that the layout information matchesthe matching pattern, predetermined metadata is sent to a predeterminedapplication.

Any of the processes and functions described above in the presentembodiment may be realized using a computer-readable program.

It is to be understood that the present invention may also beaccomplished by supplying a system or an apparatus with a storage mediumin which a program code of software, which realizes the functions of theabove described embodiment, is stored, and causing a computer (or CPU orMPU) of the system or apparatus to read out and execute the program codestored in the storage medium.

In this case, the program code itself read from the storage mediumrealizes the functions of the above described embodiment, and thereforethe program code and the storage medium in which the program code isstored constitute the present invention.

Examples of the storage medium for supplying the program code include afloppy (registered trademark) disk, a hard disk, a magnetic-opticaldisk, an optical disk, such as a CD-ROM, a CD-R, a CD-RW, a DVD-ROM, aDVD-RAM, a DVD-RW, or a DVD+RW, a magnetic tape, a nonvolatile memorycard, and a ROM. Alternatively, the program may be downloaded via anetwork.

Further, it is to be understood that the functions of the abovedescribed embodiment may be accomplished not only by executing theprogram code read out by a computer, but also by causing an OS(operating system) or the like which operates on the computer to performa part or all of the actual operations based on instructions of theprogram code.

Further, it is to be understood that the functions of the abovedescribed embodiment may be accomplished by writing a program code readout from the storage medium into a memory provided on an expansion boardinserted into a computer or a memory provided in an expansion unitconnected to the computer and then causing a CPU or the like provided inthe expansion board or the expansion unit to perform a part or all ofthe actual operations based on instructions of the program code.

Further, it is to be understood that the functions of theabove-described embodiment may be accomplished not only by executing theprogram code read out by a computer, but also by causing an OS or thelike which operates on the computer to perform a part or all of theactual operations based on instructions of the program code. In thiscase, the program code is supplied directly from a storage medium inwhich the program code is stored, or is supplied by downloading fromanother computer, a database, or the like, not shown, connected to theInternet, a commercial network, a local area network, or the like.

While the present invention has been described with reference to anexemplary embodiment, it is to be understood that the invention is notlimited to the disclosed exemplary embodiment. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all modifications, equivalent structures and functions.

This application claims priority from Japanese Patent Application No.2007-323360 filed Dec. 14, 2007, which is hereby incorporated byreference herein in its entirety.

1. An image processing apparatus comprising: an acquisition unit adaptedto acquire image data; a generation unit adapted to generate metadatafor the image data; a registration unit adapted to register an outputdestination to which the generated metadata is to be output; and anoutput unit adapted to output the image data to the output destination,wherein said output unit outputs the metadata only when the image datais output to the registered output destination.
 2. The image processingapparatus according to claim 1, wherein said generation unit generates aplurality of metadata items, wherein said registration unit registersdifferent metadata items in association with respective outputdestinations, and said output unit outputs a metadata item associatedwith the output destination to which the image data is to be output. 3.The image processing apparatus according to claim 1, further comprisinga vector data forming unit adapted to convert the acquired image datainto vector data, and wherein said output unit outputs the image dataconverted into vector data, as the image data to be output.
 4. The imageprocessing apparatus according to claim 3, wherein said vector dataprocessing unit divides the acquired image data into a plurality ofobjects selected for classification from a category group consisting ofa character object, a thin line object, a graphic object, a tableobject, a natural image object, and a background object, and convertseach of the objects into vector data.
 5. The image processing apparatusaccording to claim 4, wherein said vector data processing unit generateslayout information indicative of a layout of the objects divided forclassification.
 6. The image processing apparatus according to claim 1,wherein the metadata contains wraparound information indicative of aposition where a character string is to wrap around.
 7. The imageprocessing apparatus according to claim 1, wherein the metadata includeskeyword information for use in retrieving a thin line object or agraphic object.
 8. The image processing apparatus according to claim 1,wherein the metadata includes information concerning a title of a tableobject.
 9. The image processing apparatus according to claim 4, whereinthe metadata is formed by combining a plurality of information items onthe objects.
 10. The image processing apparatus according to claim 5,wherein said registration unit performs comparison between the layoutinformation generated by said vector data processing unit and apredetermined matching pattern, and registers an output destination towhich the metadata is to be output, based on a result of the comparison.11. The image processing apparatus according to claim 1, wherein saidregistration unit identifies the output destination to which themetadata is to be output, based on an application type.
 12. The imageprocessing apparatus according to claim 1, wherein said registrationunit identifies the output destination to which the metadata is to beoutput, by a person or an organization.
 13. The image processingapparatus according to claim 1, wherein said registration unitidentifies the output destination to which the metadata is to be output,by a geographic region.
 14. An image processing method for controllingan image processing apparatus, comprising: acquiring image data;generating metadata for the image data; registering an outputdestination to which the generated metadata is to be output; andoutputting the image data to the output destination, wherein saidoutputting includes outputting the metadata only when the image data isoutput to the registered output destination.
 15. A storage mediumstoring a program for causing a computer to execute an image processingmethod for controlling an image processing apparatus, wherein the imageprocessing method comprises: acquiring image data; generating metadatafor the image data; registering an output destination to which thegenerated metadata is to be output; and outputting the image data to theoutput destination, wherein said outputting includes outputting themetadata only when the image data is output to the registered outputdestination.
 16. An image processing apparatus comprising: aregistration unit adapted to generate a plurality of metadata items forimage data, and register the plurality of generated metadata items eachin association with information on a transmission destination type; adetermination unit adapted to determine, when transmitting the imagedata stored in a storage to a transmission destination, a metadata itemwhich is associated with the type of the transmission destination, fromthe plurality of generated metadata items; and a transmission unitadapted to transmit the image data and the determined metadata to thetransmission destination.
 17. An image processing method comprising: aregistration step of generating a plurality of metadata items for imagedata, and registering the plurality of generated metadata items each inassociation with information on a transmission destination type; adetermination step of determining, when transmitting the image datastored in a storage to a transmission destination, a metadata item whichis associated with the type of the transmission destination, from theplurality of generated metadata items; and a transmission step oftransmitting the image data and the determined metadata to thetransmission destination.
 18. A computer-readable storage medium storinga computer program, wherein the computer program causes a computer toexecute: a registration step of generating a plurality of metadata itemsfor image data, and registering the plurality of generated metadataitems each in association with information on a transmission destinationtype; a determination step of determining, when transmitting the imagedata stored in a storage to a transmission destination, a metadata itemwhich is associated with the type of the transmission destination, fromthe plurality of generated metadata items; and a transmission step oftransmitting the image data and the determined metadata to thetransmission destination.